Discovery and registration of components in multimodal systems distributed on the IoT

One of the major gaps in the current HTML5 web platform is the lack of interoperable means for an application to discover services and applications available in a given space and network. This problem is shared by the multimodal applications developed with web technologies, for example, in smart houses or applications for the Internet of Things. To address this gap, we produced a SOA approach for the W3C’s Multimodal Working Group that aims to allow the discovery and registration of components used in multimodal interaction systems in the web of things. In this approach, the components are described and virtualized in a dedicated module communicating with two dedicated events, and registering components in a Resources Manager to facilitate the fine management of concurrent multimodal interactions, and the interoperable discovery, registration and filtering of features provided by heterogeneous and dynamic components in the web of things. Keywords-component; Multimodal Interaction, Semantic Interaction, Interface Services, MMI Architecture and Interfaces, Pervasive computing, Context awareness